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Abstract 

From the perspective of probability, the stability of growing network is studied 
in the present paper. Using the DMS model as an example, we establish a relation 
between the growing network and Markov process. Based on the concept and technique 
of first-passage probability in Markov theory, we provide a rigorous proof for existence 
of the steady-state degree distribution, mathematically re-deriving the exact formula 
of the distribution. The approach based on Markov chain theory is universal and 
performs well in a large class of growing networks. 
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1 Introduction 

Networks are all around us, and we are ourselves, as individuals, the units of a network 
of social relationships of different kinds and, as biological systems, the delicate result of a 
network of biochemical reactions. Networks can be tangible objects in the Euclidean space, 
such as the Internet, highways or subway systems, and neural networks. Or they can be 
entities denned in an abstract space, such as networks of acquaintances or collaborations 
between individuals. 

In the investigation of various complex networks, the steady-state degree distributions of 
networks are always the main concerns because they characterize the fundamental topological 
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properties of the underlying networks. The usual case in Science until a few years ago was 
homogeneous networks. Homogeneity in the interaction structure means that almost all 
nodes are topologically equivalent, like in regular lattices or in random graphs. However, 
when the scientists approached the study of real networks from the available databases, 
it was found that most of the real networks display power law shaped degree distribution 
p(k) ~ Ak~^ . Such networks have been named scale-free networks, which was first proposed 
by Barabdsi and Albert W in 1999 (called BA model hereafter). 

The BA model is starting with a small number (mo) of nodes and based on two basic 
ingredients: growth and preferential attachment. The probability that a link of new node 
will connect to an existing node % is proportional to the degree of node i. i.e., n ? ^j = ^\ 

(how getting started). The BA model has been solved in the mean-field approximation' 2 ' . 
There, to derive the following dynamic equation: 

^ = ™n(*0 = |. (i.i) 

it was assumed that the probability for an existing vertex to receive a new connection from 
the new vertex is exactly equal to mll(fc i ) (it is called mH-hypothesis in [3]). 

Since the ground-breaking papers by Barabdsi and Albert' 1,2 ' on scale-free networks, 
the interest on large scale, growing complex networks has soared. In addition to analytic 
and numerical studies of the model itself, many authors have proposed many modified and 
generalized models' 4 ' 5,6 ' such that the model can fit real networks well. 

Especially, S.N. Dorogovtsev, J.F.F. Mendes and A.N. Samukhin' 4 ' proposed a general 
attractiveness model(also called the DMS model in [5]). 

At each time step a new site appears. Simultaneously, m new directed links coming out 
from non-specified sites are introduced. Let the connectivity q s be the number of incoming 
links to a site s, i.e., to a site added at time s. The probability that a new link points 
to a given site s is proportional to the following characteristic of the site: A s = A + q s , 
thereafter called its attractiveness. All sites are born with some initial attractiveness A > 0, 
but afterwards it increases because of the q s term. 

It is convenient to assume that initially (t = 1) we have one site with m incoming links, 
when t > 2 sites are born with zero connectivity (i.e., without incoming links). 

Note that one may allow multiple links, i.e., the connectivity of a given site may increase 
simultaneously by more than one. ■ ■ ■ The probability that a new link is connected with the 
site s equals -j*-, where Aj^ = (m + A)s. The probability for the site s to receive exactly I 

new links of the m injected is P S M) = (D(^)'(l - ^) m ~ l ■ 

Dorogovtsev et al. first derived the master equation for the distribution P(q, s, t) of the 

connectivity q of the site s. Next, the connectivity distribution of the entire network is 

t 

defined by P(q,t) = \ £.P(g,M). Finally, assuming that the limit P(q) exists (note that 

i=l 

actually an additional assumption of lim t(P(q,t + 1) — P(q,t)) = is also needed), they 

t— *oo 

get the following equation for the stationary connectivity distribution: 

(1 + a)P(q) + (q + ma)P(q) - (q - 1 + ma)P(q - 1) = (1 + a)5 q0 , (1.2) 
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where a = A/m. Then one may use the Z transform of the distribution function to obtain 
the following formulas: 



P(q) 



(1 + a) 



r[(m+ l)a+ 1] 



r(g + ma) 



(1.3) 



r(ma) 



r[g + 2 + (m + l)a]' 



Remark: The attractiveness model has overcome two problems of the BA model, which 
were pointed out by Bollobds in [6]. 

(1) The introduced parameter A, the initial attractiveness, governs the probability for 
'young' or isolated sites to get new links. 

(2) Because a site may allow multiple links, one need no mil-hypothesis, though we have 
found an efficient way to realize this hypothesis [2]. 

Shi et al.' 7,8 ' established a corresponding relation between growing networks and Markov 
chains, and proposed a computational approach for network degree distributions. Consider 
the degree qi(t) of node % at time t. Based on the preferential attachment mechanism of 
the BA model, the stochastic process qi(t), t — i, i + 1, • • • is a nonhomogeneous Markov 
chain. Thus, the dynamics of a node from the time it joins the network is described by 
a nonhomogeneous Markov chain and the whole network (excluding the initial nodes) is 
completely described by a family of Markov chains {qi{t)}, i = 1,2, called network 
Markov chain. 

Our research is mainly motivated by the following observation. 

(1) The existence of the steady-state degree distribution is the basic issue in the research of 
network degree distribution. However, from the discussion above, we know that it is unsolved 
in a considerable amount of models. 

(2) There are all kinds of networks and each has its own evolving mechanism, such as allowing 
multiple links, loops or not, etc.. Therefore, it will be interesting if we can find a general 
way to study them. 

In the present paper, we will provide a general way to study the steady-state degree 
distribution for the growing network. To show the feasibility and efficiency of our method, 
we concentrate primarily on the DMS model. First, we will construct a network Markov 
chain for the DMS model. Then, based on the concept and techniques of first-passage 
probability proposed by Hou, et alS 3 \ we provides a rigorous proof for the steady-state 
degree distribution of the DMS model, and mathematically re-deriving the exact analytic 
formulas of the distribution. But compared with the paper [2], the network Markov chain 
{qi(t)} here is a general growth process which can jump m states after a transition, not 
pure-birth process being considered in [3]. Thus, we greatly generalize the results obtained 
in Hou et al.. 



The attachment mechanism of the DMS model indicates that the future evolution of the 
in-degree qi(t) as a process is independent of the past history, given its current state. We 
can observe that the sequence {qi(t), t — i, i + 1, • • • } is a nonhomogeneous Markov chain 



2 Stability analysis 
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with the state space Q = {0, 1, 2, ■ ■ • }. Thus, the state transition probabilities of the Markov 
chain are given by 



p(fc(i + l) = Z|fc(<) = q) 



m\r g+A ijr-, q+A , , • q < • < 



0, otherwise. 

where g = 0, 1, 2, ■ ■ • , m(t — i) and z = 2, 3, ■ ■ • . 

Let P(q, i, t) = p{qi(t) = q} denote the probability of vertex % having in-degree q at time 
t, which has initial distribution as follows 

P(Q, 1, 1) = PUii 1 ) = ( l} = 8q,m, 

P(q, i, i) = p{qi(i) = q} = S q ,o, for i > 2. 

Define the degree distribution of the whole network by the average value of probabilities of 
the vertex degrees 



P(q, t)±\j2 P(q, i, t) = - t P(q, 1, t) + £ P(q, h t). 



8=1 



(2.2) 



i=2 



Next, denote P(q, t) = — ^ P(q, h 0- We om y nee d to prove that lim P(q, t) exists, which 



i=2 



t— >oo 



will imply that lim P(q,t) = lim P(q,t) exists. 

t— »oo t— >oo 

Denote the first-passage probability of the Markov chain by f(q,i,s) = P{g.j(s) = 
7^ = 1) 2, • ■ • , s — 1}. Relationships between the first-passage probability and 
the probability of vertex degrees are established. 

Lemma 2.1. For q > 0, 



min(m ,j) 

< 



g ~ J + A 
(m + A)(s - 1 

t-l r 



1 - 



g - j + A 

(m + A)(s - 1; 



m-j 



P(q-j,i,s-l), (2.3) 



P(g,i,t) = X)/(9. i » s )I 



S=<0 



3=s 



1 - 



(m + A)j 



i+[q/m], [q/m}=q/m; _ ^ 
i+[q/m] + l, [q/m] ^ g/m. 



Proof. First, consider Eq.(2.3). According to the construction of the attractiveness model, 
the in-degree of a vertex is always nondecreasing, and increasing at most by m each time. 
Thus, it follows from Eq.(2.1) that 

f(q,i,s) = P{qi(s) = q, q^l) ^ q,l = 1,2, ••• ,s - 1} 

= P{g 4 (s) = q, qi(s -l)=q-l, qi (l) ^ q, I = 1, 2, • • ■ , s - 2} + • • • 

+P{g 4 (s) = g, gi (s - 1) = q - m > 0, ft (Z) ^ g, / = 1, 2, • • ■ , s - 2} 
= P{g»(s) = g, g<(s - 1) = g - 1} H h P{gi(s) = g, g^s - 1) = g - m} 

min(mj') 

= £ J ' vs ~ 1 M&( 5 ) = - 1) = q - j} 

min(mj) 

= E (J 



g - j + A 



(m + A)(s - 1] 



q-J+A 



1 m-j 



(m + A)(s - 1) 



P(q-j,i,s- i)- 



Second, observe that the earliest time for the in-degree of vertex i to reach q is at step 
to, and the latest time to do so is at step t. After this vertex degree becomes q, it will not 
increase any more. Thus, Eq.(2.4) is proved. □ 

Lemma 2.2. (Stolz-Cesdro Theorem) Let x n andy n be two sequences of real numbers. If y n 
is positive, strictly increasing and unbounded and the following limit exists: 

hm = /. 

n-oo y n+l - y n 

Then the limit lim — also exists and it is equal to I. 

Proof. This is a classical result, see [9]. □ 
Lemma 2.3. For the probability P(0,t) defined in (2.2), lim P(0,t) exists and is indepen- 

t— >oo 

dent of the initial network; moreover, 

P(0) ^ lim P(0,t) = A . 

Proof. By the definition of network degree and P(0,t + l,t + 1) = 1, together with 

A lm 
(m+A)ti ' 

t+l 



P(0, i, t + 1) = P(0, z, t) [1 - Tz^r, it follows that 



P(0,t+1) = i^P(0,z,t+l) 

f i=2 
1 * 

= -[^P(0,M+l) + P(0,t + l,t + l)] 



-yp(o,z,t)[i- - A - r + 

* ^ (m + A)t J 

/ — 1 4 1 

— p(o,t)[i - - — — r + -. 

t v n (m + A)r t 



Then, by iteration, we have 



111 1 (m+A)ji j 
3=2 

1 A l ~ l 1 A 



(m + A)z ^A = l (m + A)j 



Next, let 



x 



n-l I 

(=2 j=2 
n-l 

y n =(n-l)IJ[l 

i=2 

5 



.4 



(m + A) j ' 

A ] 



Thus, it follows that 

A 



[m + A)i 



i=2 
n-1 



A , A 



Vn+l ~ Vn = lit 1 " , TAY ^W 1 ~ I I T\ J"" " ^ " 

Since y n > and y n+ i — y n > 0, {?/„} is a strictly monotone increasing nonnegative 
sequence, hence, y n — > oo. Moreover, 

[1-7= 



■En I- (m+A)n 



m + A 

~^ a 7 V n °°). 

m + A + mi 

From Lemma 2.2, one has 

P(0) 4 hm P(0,t) = lim ^ = hm ~ Xn 



t->oo n->oo y n n-»oo y n+ i — y n 771 + A + 77ly4 

This completes the proof. □ 

Lemma 2.4. For any positive integer q, if lim P(q — l,t) exists, then lim P(q,t) also exists 
and, moreover, 

P(q) 4 lim P(g, t) = g^-^TTZ 4 P ( g - *)■ ^ 
t^oo m(g + /L + l) + yl 

Proof. For any positive integer g, using Eq.(2.1) and (2.3) we see that 

1 * 

P(q,t) = — M) 

i=2 



^E E ^ 

i=2 «=[£]+< 7=» V " 



For simplicity, let 



4 . _ wr g-i + ^ pr-, q-j + A ■ 



and 



%*)^E £ A ^-i^s-i)\\[i-^±^r, i<i< m . 
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Then, by Eq.(2.2), we see that 

1 - 

P(q,t) = —Y,P{q,iit) 

i=2 

. t i 

ZTjYl Yl [AiP{q-l,i,8-l)+A 2 P(q-2,i,8-l) 



t-i 



+ ... + A m P(q-m,i,s-l)]l[[l 



(m + A) j 

= P 1 (q,t) + P 2 (k,t) + --- + P m (q,t). 
(1) Consider the case that the degree of vertex increases only by 1 at each step: 

' T^t £ ™n* - 1. <• - 1) (m ? + + ^ ( ;_ i) t 1 - ( m + + ^(7- D r_1 - (srjji 

s— [— J+« J — * 

t »-[£] t-1 

g + A-1 g + A-1 r -iTT fl _ q + A 

= p(q-i 3-D q + A ~ 1 \i- q + A ~ 1 r^TTn- q + A r 

t ~ l s ^ ]+2 m + A (m + A)(,-l) J l = l [i (m + A)j l 
= m ( 1 + A ~ 1 TT ri_ 1 + A p [-g-l + Dfl 9 + l m_1 



Let 



L m. J «* L m. J ' 



9i , g + A-l lm _i 



x n = P(g-l,[^] + l)[l 



n-l 



Q + A im-1 TT n <? + ^ 



+ E %-^)[i- 7 ^r- 1 n i 1 



(m + v4)s - LJ - (m + A)j' 

s=w+i v ; j=F+i 



n-l 



ra — 1 m + A t-i- g + A 

T 11 ^ 



m q + A — 1 f m + A) 7 ' 
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Obviously, 



[m + Ajn - LJ - (m + A)j 



<™ + 4L fr n _ 7 !±4-]-> [ i - - (n - 1)] > o. 



2/n+l - Vn 



m(q + A — 1) ^ + (m + A)n 



Since {?/„} is a strictly monotone increasing nonnegative sequence, hence y n — > oo. Also, 
by assumption, 

- x n P{Q ~ l,n)[l - fi^Ml - -^~ m 



2/n+l - J/r; 



From Lemma 2.2, one has 



(m.+A)n! L (m+AJnJ 
^[-[l"(^]- m -(--l)] 

P(g-l,n). 



m(g + A — 1) 



m(g + A + 1) + A 



lim P^t) = hm ^ = lim = ^^"^, P(g - l,n). 

(2) Consider the case that the degree of vertexes increases by 2 simultaneously at each step: 
P 2 (q,t) 

<l + A-2 l2n g + A-2 lm _ 2 ^ M g + A 



^E E p (« " 2 - ! - s " ^l")' (^1(731) ' 2[1 - <^riy(7^T) r " 2 ni 1 - (m + Ab - 



(g + ^4-2) 2 M g + A-2 lm _ 2 ^ h g + A 



t ~ l s= Xt ]+2 '( m + A ns-iy ( m + A)(s-iy j= s (m + A)j- 

{f){q + A-2) 2 h g + A mr -. or g ll1 , 1 M g + A - 2 



( m + A)'(f-l) JJIj 1 (m + A)j r{P(g 2 ' [ m ] + 1) [^] + l [1 (m + + iy 

+ £ p(g-2, s) i[i-f±^r" 2 n ^-r^v^- 

^ s m + A s - LJ - (m + A ? 



im-2 



Let 



9i . ^ 1 m g + ^-2 lm _ 2 



x n = P( g -2,[^] + l)-— — [1- 



W + (m + A)([^] + l) 

+ V ^-2,,)-[i-^^r- 2 TT[i- 7 ^4 

v e L f -I- e J ll l (rr> S- A 



s (m + A)s Al (m + A)j- 



2/n 



(n-l)(m + A) 2 yy g + A . 

(r)(g + A-2)2 . 11 J (m + A)j 
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Obviously, 

x n+1 -x n = p(k-2,n) l -[i- q 1 ±^r^ n 

n \ nm -\- A\n J- J. I rn -U A 



n (m + A)n H (m + A)j m 

J L in J 

(m + A) 2 tt n ? + ^ ,- ra r h Q + A m 

Vn+i -Vn= " 1 - ; j-ttt m n 1 - m - (n - 1 > 0. 

Since is a strictly monotone increasing nonnegative sequence, hence y n — > oo. Also, 
by assumption, 

x^-x ^(9-2,n)^[l- r 4^]- m [l- 7 2±^f] m - 2 

•^n+l J'n v ^ ' / n L (m+A)nJ I- (m+A)n> 

= 0(—) — > (when n — > oo). 
rt 

From Lemma 2.2, one has 

lim P 2 (q,t) = lim — = lim — = 0. 

i^OO n ^oo y n n^oo y n+1 _ y n 

Similarly, for 2 < 2 < m, we can prove 



Hence 



P\q, t) = o(-) -> (w/ien t -> oo). 



limP{qit) = ^+ A ;» - P( g -i). 

i->°c v y m(g + A+l) + A v y 



□ 



Theorem 2.1. For an?/ positive integer q, the steady- state degree distribution P(q) of the 
DMS model exists, and is given by 



m + AV{A + j + l) Y(q + A) 
(q> ™ r(A) T( q + A + 2 + i) ^ 

m 1 (A) 

Proof. By induction, applying Lemma 2.3 and 2.4, we easily see that the steady-state 
degree distribution of the DMS model exists. Following from Eq.(2.4) by iteration till k — 1, 

. , m(q + A—l) . . 

hmP g,t = g — — ^ P g-1 

r(A + f + 2) r( g + A) 

r(A) r( g + A + 2 + ^) 1 } 

m + AT(A + ± + l) T(q + A) 
m T{A) r(g + A + 2 + 
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For large q values the above formula simplifies further, because in that case lim 



q p . Thus, for large q, we have 



P(q) 



m 



AT(A+A + 1 



m 



T(A) 



□ 



Specially, if one sets A = m and every new site is the source of all the m new links, in this 
case, the model that we consider is equivalent to the BA model, except permitting multiple 
links. From Eq.(2.4), we get by iteration 



P(q) = lim P(q,t) 

t— >oo 



2m(m + 1} 



(q + m)(q + m + l)(q + m + 2) 



2m(m + l)q 3 . 



3 Conclusion 



(1) For general growing networks, we can first establish the corresponding Markov chain, 
and then prove the steady-state degree distribution similarly. 

(2) From the proof above, we can conclude that multiple edges do not affect the steady- 
state degree distribution. Because for long times, the probability to receive simultaneously 
more than one link of the m is vanishing. 

(3) The process qi(t) considered in Hou, et al^ is a pure birth Markov chain, and the 
corresponding transition probability matrix is 



Pmm Pm(m+1) 

P(m+l)(m+l) P(m+l)(m+2) 



P(m+t-i)(m+t-i) P(m+t-i)(m+t-i+l) 



(3-1) 



where pik = p{qt{t + 1) = k\qi(t) = I}. However, in the present paper, what we study is a 
general growing process. The corresponding transition probability matrix is 



Poo Poi ■■■ 
Pu Pu 



POm 



Pl(m+1) 



P[m(t-i)][m(t-i)] P[m(t-i)][m(t-i)+l] " " " P[m(t-i)][2m(t-i)] 

1 



(3.2) 



And when p^ = 0, for k > l + l and Pm = for k > m + t — i in (3.2), namely the vertex 
can only gain one link at a step, we gain the results in [3]. Hence, the results obtained in [3] 
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are generalized in this paper. More generally, we provide a general way for the proof of the 
steady-state degree distribution of growing network, whether allowing multiple links, loops 
or not . 
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